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[57] ABSTRACT 

A search facility having a user interface including three 
windows: a query window, a graph window and a history 
window. Each of the windows Ls presented simultaneously in 
the graphical user interface. The query window displays the 
text of the most recently input query statement which is 
searched in a database stored in a computer system. The 
graph window graphically displays the current results of the 
most recent query statement. The history window presents 
the query statements and their results during the current 
query session. In one preferred embodiment, the query 
statements and their results are graphically presented as a 
tree, wherein the query statements and query results are 
nodes and each query statement result is a child of the query 
statement which was run to create it. Input to any of the 
windows will change the presentation of data within the 
other two windows. 
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DATABASE SEARCH E\CIL1TY HAVING It is another object of the invention to change the set of 

IMPROVED USER INTERFACE query statements by manipulating the graphical presentation 

of the query resuh. 

BACKGROUND OF THE INVENTION \{ is another object of the invention to graphically repre- 

TTiis invention relates generally to computer stored data- ' relationship of the query statements and query 

bases. More particularly, it relates to a system, program and ^^^^^ ^ S^^P^^^^^ 

method for accessing a database utilizing a graphical user These and other objects are accomplished by a search 

interface. facility having a user interface including three windows: a 

Cbmputer stored databases have attracted an increasing jo 'If!?' » ""^ " T''"'^- 

amount of interest, not only because of the rapid expansion °f windows is presented concurrently in the graphical 

in the data stored and retrieved by these databases, but also interface. The query window displays the text of the 

as a resuh of the data relationships which can be estabUshed °>°Sf ««»>fly 'f''^ Statement whl^ IS searched ID a 

during the storage or retrieval processes. With the growing database stored in a computer system. Tie graph wmdow 

prevalence of relational databases, the training and experi- ,5 g«phicaUy displays the current results of the m<»t recent 

ence of a typical end user has decreased as the available 'l^^'y statement. The history window presents the qtiery 

resources have increased. Users of databases have been statements and their results during the current query SMSion. 

particularly desirous of improvements in the graphical user '° °f prciencd embodiment, the query statements and their 

interfaces to control the database applications to make them '^^'^^ graphicaUy presented as a tree, wherem the query 

understandable by the novice user. ^ .^^^^y .ff^"? "* 

- , , . ,, , . statement resuh IS a child of the query statement which was 

One of the more ditBcuh elements of problem solving searched to create it 

when using a database is often the identification of the , ,. . . , ... , 

sourcesthatcauseaparticularproblem.Seaichstatementsor Input to any of the wmdows will change the presentaUon 

queries are usuaUy used for searching information stored in °^ ''""^ """""J, '"^^ ^''"'""'^ 

a database in an organized fashion to help problem solving. 25 statements will change the graphical presentation of the 

When users have few clear ideas about how to construct the '^^"^^ "> "^^ graph window and add new nodes to the tree 

proper query for solving a problem, a common approach is P«sented m the history window. By manipulatmg the 

to start by examining an initial query report resulting from graphical pre^ntaUon of the results m the graph window, 

an initial query for more information. Based on this """^ °' modified query statements are generated and pre- 

information, the user then decides how to narrow the search, 30 1"«fy ^ "'l?^' "hich also add nodes to the 

or "drill down" further within the database. If these nar- "f' °7 ^'f ""S particular nodes m the tree m 

rowed searches do not produce the desired result, then the !"^'°fy '^e user can return to and modify 

user must back up to a previous search statement and try P'f^""^ "l""'^^ ^° construct new query statements. By 

selecting the root node m the history wudow, the user can 

„ ' u ' L . L .. ■ initiate a new query statement independent of any previous 

Current search techniques are cumbersome, mhibmng 35 q^^ry statement. The new or modified query stateinents are 

efficient query formulation. Most existmg systems do not ^^^^^^ ^ ^ ^^^^ j„ ^ 

provide a query history. These systems make iterative prob- ^^^^ ^^^^j^ ^ ^^^^ ^^^^ 
lem solving dimcult by lorcing the user to 1) remember all 

previous results, or 2) manually save or print the query and BRIEF DESCRIPTION OF THE DRAWINGS 

result. This is cumbersome. ^ ^ , r 

„ * *L * J -J . II -J These and other features, advantages and objects will be 

Those systems that do provulc a histonr usuaUy provide ^^^^ understood «dth refer^ce to the following 

some sort of hnear log. Many commeraaUy available data- description and attached drawings. 

bases have a history command which allows the user to ^ 

access this log. The information within the log is usually not ^ depicts a computer system mcluding system 

adequate. It may contain the number of "hits" which satisfy display, system unit, mouse and keyboard, 

a search particular set of statements. It may contain nothing FIG- 2 is an architectural block diagram of the computer 

more than the initial query. The problem with these system in FIG. 1. 

approaches arc two fold. First, the log is presented in a linear FIGS. 3A-3D depict the graphical user interface of the 

way. This linear presentation does not reflect the actual search system. 

problem solving process, where one query may be refined to piG. 4 depicts the data structures used to present the 

produce another. Second, there is no convenient way to graphical user interface depicted in FIGS. 3A-3D. 

access the log. Further, when invoked, the history command ^A-SC are flow diagrams of the search process as 

removes both the detailed query statement and the detailed ^he user manipulates the graphical user interface depicted in 

results or the last query statement from the display. The user FIGS 3A-3D 

must recall these details in the context of the limited ™* ^ . w % - . ^ r.i. 

_ u w i- u** Ai*i- 1 FIG. 6 IS the graphical user mterf ace of the search system 

summary when altenng his search strategy. Also, the only u-^u i^-j . .-j- .. 

_ . • . u . « u u • . •/ wherem the graph window presents a multimedia data 

method m most search systems to change a search IS to wnte cir<.nm & r f 

additional query statements. 

SUMMARY OF THE INVEN^HON 



stream. 

DETAILED DESCRIPTION OF THE DRAWINGS 



The invention may be run on a variety of computers or 

The present invention represents an improvement over collection of computers under a number of different oper- 

prior art database search systems. aiing systems. The computer could be, for example, a 

It is therefore an object of the invention to present a query personal computer, a mini computer, mainframe computer or 

statement and a graphical representation of its result when 65 a computer running in a distributed network of other com- 

searched in a database simultaneously in a graphical user puters. Although the specific choice of computer is limited 

interface . only by disk and disk storage requirements, computers in the 
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IBM PS/2 (TN4) series of computers could be used in the controller 29 provides the hardware interface for nnouse 13, 

present invention. For additional information on IBM's PS/2 the video controller 30 is the hardware interface for the 

series of computers, the reader is referred to Technical display 14, and the audio controller 31 is the hardware 

Reference Manual Personal Systems/2 Model 50, 60 sys- interface for the speakers ISa and 156. The speakers 15fl and 
terns IBM Corporalion, Part No. 68X2224 Order Number 5 156 may be used to present audio objects to the user. An I/O 

S68X-2224 and Technical Reference Manual Personal controUer 40 such as a Tolan Ring Adapter enables com- 

Systems/2 (Model 80) IBM Corporation Part No. 68X 2256 mumcation over a network 46 to other smiilarly configured 

Order Number S68X-2254. One operating system which an processmg systems. 

IBM PS/2 personal computer may run is IBM's OS/2 2.0 ^ne of the preferred implementations of the present 
(TM). For more information on the IBM OS/2 2.0 Operating lo invention is as a set of instructions in a code module resident 

System, the reader is referred to OS/2 2.0 Technical Library, ^^^dom access memory 24. Until required by the 

Programming Guide Vol. 1, 2, 3 Version 2.00 Order Nos. computer system, the set of instructions may be stored m 

10G6261 10G6495 10G6494. another computer memory, for example, in the hard disk 

- . ' . . '.1. . . • i_ • .1. drive 26, in an optical disk for eventual use in the CD ROM 

In the alternative, the computer system might be in the • j- i r » , • *u « j- i 

WTJXA nici- c * /innn Ar»>r\ i" e . u u 32 or m a floppy disk for eventual use m the floppy disk 

IBM RISC System/6000 0 M) Ime of computers which run ^5 J^^^ • *u c .u * in j 

.u Aiv /4nv>r\ ♦ nn, ' f dove 27. As showH in the figure, the Operating system 50 and 

on the AIX (TM) operating system. Ine vanous models of , j » • n xx^'y^ , 

.L mo/-, o . t^nr^f^ J u j • ui' presentaUon manager 52 are resident in RAM 24. In this 

the RISC System/6000 are descnbed in many publications ^ i *u • «• • u ^ • u . 

c .u wni^M r> *• r i nrt^r^ J * t^r^nn. example, the invention IS embodied in a search system 54 

of the IBM CorporaUon, for example, /?/5C 5yA7eni/6000, . iT u i.u cic i.r *u 

J -rni i= n*r>Ti/i7D * *- J Dy-kii/ro rr _j which searches a database 56 and utilizes the operating 

7073 ana 7016 POWERstation ana POwERserver Hard' , . . ^ . ^^ttt o 

T I. • I c J KT cAnin£.AAnn tu on system or presentation manager to present the GUI. Some 

ware Technical reference. Order No. SA23-2644-00. The , u /-vc/i u u ^ 

. , - J -i_ J • 1^ • J operating systems such as OS/2 have an embedded presen- 

AlXoperatmg system IS descnbed mGe/iera/Co/zc£ip/:$a^ ^ ^ 

n J frvTi- • -» /■ nroy- o * i/rftrt<^ j ».t tatioH manager. Other systems use a presentation manager 

Procedure— AIX Version 3 for RISCSystem/SOOOOTdtT No. . .Ji • r ^ au « i7i_ 

o^-* ^^rt/^ rtrt 11 i-i- r m»* which IS a Stand alone piece of code. Alternatively, the 

SC23-2202— 00 as well as other publications of the IBM uu -i .ji 

Co oration present invention could be implemented in a stand alone 

^ ' application which has its own graphical user interface. 

In no 1 a computer 10 comprising a system unit ll^a ^ statements which are used to retrieve information 

keyboard 12 a mouse 13 and a d^play 14 are depicted. The ^^^^ databases are well known to the art. For example, the 

screen 16 of display device 14 is used to present the ^^^^^^^ ^ ^an (SQL) is one 

graphical user interface (GUI). The graphical user mterface language for composing such statements. A query will define 

supported by the operating system allows the user to use a i„ compuleriecognizabte terms, the tables' in which the data 

pomt and shoot method ot input, i.e., by movmg the mouse ^ ^^ ^. ^^^^^^ columns of interest, the conditions 

pomter 15 to an icon representing a data object at a particular ^^^^ ^^^^^^ ^^^er of columns, distinctiveness 

location on the screen 16 and pressmg one of the mouse constraints, connections of data within tables and other 

buttons to perform a user command or selection. relationships. The reader is referred to a text describing SQL 

HG. 2 shows a block diagram of the components of the 35 and its uses in IBM Operaiina Systemsll Extended Edition 
personal computer shown in FIG. 1. The system unit 11 Database Manaaer Structured Query Language (SQL) con- 
includes a system bus or plurality of system buses 21 to cepts booklet published by the IBM Corporation in 1991. 
which various components are coupled and by which com- ^^en a Hnk is provided to tie the query statement, its 
mumcation between the various components is report or results and the query history together, the user can 
accomplished, The microprocessor 22 is connected lo the ^ interactively see a query result, manipulate a query result to 
system bus 21 and is supported by read only memory (ROM) generate predicates to be added to the next query statement, 
23 and random access memory (RAM) 24 also connected to ^^^^^y updated query statement, and see the next query 
system bus 21. A microprocessor m the IBM multimedia result after the new query statement is modified and 
PS/2 senes of computere is one of the Intel family of executed. Further, a logging facility records the interacUve 
microprocessors including the 386 or 486 microprocessors. activities a user has performed on the linked query 
However, other microprocessors including, but not limited statement, query result, and query history in a problem 
to. Motorola's family of microprocessors such as the 68000, ^^^^^^ session and presents the query history in the history 
68020 or the 68030 microprocessors and various Reduced ^^^^ow Users are then allowed to use the logging facility 
InstrucUon Set Computer (RISC) microprocessors manufac- f^^k to any query statement or resuh, and then 
mred by IBM, Hewlett Packard Sun, Intel, Motorola and configure this iterative problem solving process. The search 
others may be used in the specific computer ^y^^^^ ^^^^^^ invention provides a more effective 

The ROM 23 contains among other code the Basic way for iterative problem solving than any previous method 

Input-Output system (BIOS) which controls basic hardware because a clear record of past activity is actively maintained 

operations such as the interaction and the disk drives and the and is readily available concurrently with the most recent 
keyboard. The RAM 24 is the main memory into which the 55 query statement and result. Also, a trial and error problem 

operating system and application programs are loaded. The solving session can be saved and edited to produce plans for 

memory management chip 25 is connected to the system bus future use, which greatly increases the value of this problem 

21 and controls direct memory access operations including, solving approach. 

passing data between the RAM 24 and hard disk drive 26 as shown in FIGS. 3A-n3D, the graphical user interface 

and floppy disk drive 27. The CD ROM 32, also coupled to (GUI) invention is implemented using three windows. The 

the system bus 21, is used to store a large amount of data, query window 101 contains the most recent query statement 

e.g., a multimedia program or large database. the current query. In this case, SQL is used as the query 

Also connected to this system bus 21 are various I/O language, but those skilled in the art would appreciate that 

controllers: The keyboard controller 28, the mouse control* other languages could be easily substituted. The graph 
ler 29, the video controller 30, and the audio controller 31. 65 window 102 shows the results of the query statement 

As might be expected, the keyboard controller 28 provides displayed in the query window in a graphical representation, 

the hardware interface for the keyboard 12, the mouse In this case, bar charts are used, but the user is free to choose 
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the type of graphical presentation, which could be a line Referring to the bar graph 112, he sees that sales were 
chart, a pie chart, a bar chart, a graph, or other representa- generally poor, but were good in a small price range. He 
tion. The third window is the history window 103. In the marks an area 120 on the X-axis 121 which corresponds to 
preferred embodiment of the invention, the history of the the unit price where he sees the peak in sales. In response to 
query is presented as a graphic representation resembling a 5 the sales manager*s manipulation of the graph window 102, 
tree in which all of the query statements and their results are referring now to FIG. 3C, the query window 101 is auto- 
portrayed as nodes. matically updated. The user is automatically moved back to 
The windows are all related. Modifying the query state- t^e query window 101. A pointer 134 to the modified query 
ment results in changes in the graph window to reflect the 130 stored as a node in the tree 108. 
new results for the modified query statement i.e., the query proceeding to FIG. 3D, the modified query is executed 
results, similarly, by directly manipulatmg the graph, the ^ ^^^^ ^ ^^^^^ 

user can modify the query statement as well. For example, , . 1. 1 

I . . \ „i ^ «^,v The user may contmue to work between the query and 

selecting a subset of a parameter scaled along the x-axis , . , "^^^.^ , -,1 j « . j "l -t j 

could result in further restrictions in the SQL WHERE f ^P'' ^^\^^^' '° ^'^^ ^"^"^ ^ """^ 

clause. The history window, which is a graphic depiction of °' "^J'* tree 108 to back up to some previous query 

, J *u * f *u u *i. ♦u A Statement. The record of each of the query statements and 

a log, records the activity of the user m both the query and , . , , , . . . j . j - ... 

T .j cu * * ^ * u A ,v results IS created and kept in the log and presented m the 

graph windows. Each query statement or graphed result IS ^a^*.. v .. • i... 

Fepresentedasanodein thelree.Agraphedresultislhechild "f' "'^ ^'""^ ""S such as the inanncr m whid. 

of the query statement that was run to create it. A modilied ''""y diould be presented can ^ untiated by 

^ V ^uAA «f iu^ ^t^t^r^^^* f.^^ selecting a menu item from the action bar 138. Additional 

query statement is the child or the query statement from j -i^i . j j j-. 

which it was created. GraphicaUy presenting such a progress "<^« '^^J^ ^ ""f '^"^^^^ "i^'y and its 

record allows the user to quickly find previously created 8r?Ph«=d result 143. The results presented m ttie graph 

xrj* wmdow 102 could be used in a multimedia presentation that 

query statements, which gready speeds the process of data ^7: 7^ uv uj»vv» *u a luuiiAiuvMi 

analysis ^ *- *- fuUy supports the wide and detailed views of the data. 

Many well known graphic user interfaces support a notion ,5 ^^""^'^ ^^^^ structures must be stored in RAM to present 

of "selecting. To select an object in the GUI, a user puts a ^ ^UI depicted in the precedmg figures. As showm FIG. 

mouse pointer over an object on the screen which may be a 4, resident m the RAM 24 is a tree data structure 200 which 

windowoothescreen,orinthecaseofthepreseDtinvention, "^^^^^^^^ root node 201 and several child nodes 202-205. 

a node of a tree, or a bar on a bar graph, llie operating ^^^^ i,^^^^,^^ 202-205 correspond to one of the 
system keeps track of the relative position of the objects 30 'l""^ 210, 214 or results 212, 216 objects. More nodes are 

within the GUI and the mouse pointer as it is manipulated by ^^^^^ ^« ^00 as the user conUnues his search, 

the user. The user then presses the appropriate mouse button ^^^^^"^g "^^^^ ^^^^y statement and result objects, 

to select the object. The object is then presented with The root object 201 is the root of the tree structure and is 

"selected emphasis" by the window manager, which means also a node, which wiU be used to store the graphs (results) 
that the object is visuaUy set apart from other objects, such 35 and query statements that the user creates. The NODE 

as inverting the pels around a selected object or changing the objects 202-205 are data strucmres containing a particular 

color of the border in a selected window. This selection node in the tree. Nodes can correspond to results or query 

process is commonly referred to as "clicking on" an object. statement. Nodes also contain a list of children, which are 

HGS. 3A-3D depict the graphical user interface 100 of ^^^es. The node objects include several variables 
the searching system of the present invention as it would be 40 "^eluding: NODE_QUERY, a pointer to the query object; it 

presented on the system display. In this illustrative example, ^ °ode is a graph. NODE_GRAPH, which is a 

a manager in compact disc (CD) sales for a chain of music pomter to the graph object; it is nuU if this node is a graph, 

stores needs to find the optimal price for a CD. He first, CHILD_LIST, which contains a pointer to the first of a list 

clicks on the query window 101 and is prompted for the that are chUdren of this node. Subsequem children can be 

name of the query statement. He chooses the system default, 45 traversing the NEXT_SIBUNG list. NEXT_ 

Queryl, 104 which includes search statements for price and SIBLING which contains a pointer to the next m a bstof 

store location. He fills in the query parameters to find out siblings. The last sibhng m the list wiU pomt to NULL. The 

how many units have sold at a high price (>$20) at a Parent node pomts to the first child with the variable 

particular store. He runs this query statement and asks for CH1LD_LIST above. 

the results 105 in bar graph 105 form by selecting an icon or 50 QUERY Objects 210, 214 are data structures containing 

menu item for a bar graph result or other known selection all the elements that make up a query statement. The 

procedure. The query statement and its graphed results are QUERY_NAME variable contains the name of the query 

represented as nodes 106, 107 in the tree 108. Although the statement. QUERY_BUFFER variable contains all of the 

figures show the nodes presented as alphanumeric text or data that make up the internal representation of the 
characters, icons or other symbols could be used. He sees in 55 query. The HAS_BEEN_RUN variable is a boolian flag 

the graph window 102 that the sales at this price and store that is set to true if the query has been run. 

were poor. He abandons this query. He clicks on the history The result objects 212, 216 are data structures containing 

window 103 and then clicks on the root node 109 of the tree all elements that make up a result and its graphical repre- 

108 to start over. Ilie GUI at this point in time is shown in sentation. The GRAPH_TYPE variable is the type of graph, 
FIG. 3A. 60 e.g., bar, line, pie, etc.). The GRAPH_BUFFER variable 

Referring cow to FIG. 3B, he types a new query statement contains all of the text and data that make up the internal 

110, Query2, for the total sales at another store with no representation of the graph. The RARENT_NODE is the 

restriction on price in the query window 101. He runs the query that was run to create this graph. If this graph is 

query, 110 and, produces a bar graph 112 in the graph modified, then the resulting query will be stored as a child 
window 103. Query2, HO and its results 112 are shown in 65 of this node. 

the history window 103 as nodes 114, 115 in the tree 118. Several other variables are used to keep track of the user's 

The GUI 100 at this point is shown in FIG. 3B. progress in the search. THIS_QUERY: QUERY variable is 
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used to contain the name of the query with which the user 
is working. THIS_GRAPH: GRAPH variable is used to 
contain the most recently stored result. The CURRENT. 
NODE: NODE variable is used to keep track of the user's 
position in the tree. 5 
A process flow as the user manipulates the search system'^ ' 
is illustrated in FIGS. 5A-5C, In step 300, the three win- 
dows are initialized and the current node is set to the root 
node in the tree structure. Next, the system waits for the first 
query statement firom the user. When it rec eives the oue ry jq 
state ment in step 302 , it cr eates the first query ob ject andse ts 
the^ mTerv statemenfin the OUHRflDBTJFFER va riable. 
Next, in step 304, the user is given the option of naming the 
query statement. The query name chosen is entered in the 
QUERY_NAME variable. Alternatively, a system default 
naming mechanism may be used to name the query object. 
Next, in step 306, t hequery object isj fo red as achild of the 
current node, whicfrln this caseT§"lEFroot node. Next, in 



15 



'J 



Step 308, the CURRENT_NODE variable is set to THIS_ 
NODE variable which is the current query statement. Next, Lq 
in step 310, the query statement is displayed in the query! 
window. 

At this point, the computer wails for the next user input. 
In step 312, the computer receives this input, and in step 314, 
i t categorizes the input . One of the possibilities is that the 
u ser modifies the first querv statement to write a second 
qu ery statement which will require creation ot its own quer y 
o bject . In step 316, the QUERY_BUFFER variable of the 
second query object is set to th^ new query statement written 
by the user. The process reti^ns to step, 306 where the new 
query statement is stored as a child of the current node which 
is the first query statement. A second alternative is to run the 
query which is shown in FIG. 5C. If the user action in steps 
312 and 314 is a re ciiLi ^ sjgto , d is p lay t he tree via a mous e click 
o n the history wiad q w. the process proceeds to st ep 318 
wh ere the j;earch history is retneved from stora ge. In step 
320, the tree, which is the graphical representation of the 
search history, is displayed in the history window. ' 

At this point, the search system waits for the next user? 



remms to step 322 to wait for new user input. If the user 
action is to open a node, in step 332, the system determines 
whether the node type is a query node or a result (graph) 
node. If the node is a query node in step 334, the query name 
is retrieved from the selected node and this name is assigned 
to the CURRENT_NODE variable. Next, in step 336, a test 
is performed to determine whether the query statement has 
been nm before. If so, in step 338, the results from the query 
statement are retrieved. The results, as discussed above, are 
in a child node of the query statement or current node. These 
results are displayed in a graph window in step 340. If the 
query has_ ii&t been run or once the re<;ult?; have bee n 
disptoed-ifl-a-etaplL mndo\y, theji racessjetumsJo step 310 
ill whjchJ bejquery is displayed in the quer y window. 

If the opened node in the tree is a result node, the result 
name is retrieved and assigned and the CURRENT _NODE 
variable is signed to this name, in step 342. In step 344, the 
corresponding query statement, the parent node of the cur- 
rent result node is retrieved from the parent of the 
CURRENT_J»fODE variable. In step 346, the query state- 
ment is displayed in the query window. At this point, the 
process proceeds to step 360 in FIG. SC. 
5j\lf the user input in step 314 of FIG. 5A is to run the query, 
the process as depicted in FIG. 5C is performed. First, in step 
350, a name.Qlilie-cesult_ Qode is retrie YgdirQig _^user in put 
a nd assigned tn the THTS_GR APH variable. Alternatively, 
a default mechanism maybe used to assign the result node 
name. In step 352, the type of a graphical representation of 
the desired by the user input and the GRAPH_TYPE 
variable is assigned to the user input. The graph name and 
type are stored within an object which is the child of the 
current node objecTin step 354. Next, in step 356, the 
CURRENT__NODE variable is assigned to the node ofnhe 
TH1S_N0DE variable which is the result node. In step 360, 
the results of the query statement are displaye d in the 
g raphical rcprcscnfaiion chosen by ttie user in iSe^g raph 
wiadow. 

There are many existing methods of graphing the results 



input. In step 322, it receives the input. Proceeding to FIG. Lq w hich satisfy Oie conditions ofthe q uery . .. stat ement. For 
. , . ... ... , ^ example, cbiumerciaiiy availaole spreadsheets take results 



5B, the system determin es the type of input the user mad e, 
step 324. If the user Has requested to edit the tree, in step 
326, the user may delete branches of the tree or rename 
nodes and queries or graphed resu lts. After a successful 
search has been done, it is important for others to understand 
the process that produced the desired results. The log can be 
used for that purpose. The tree can be pruned to more easily 
input the successful search. For example, nodes in which 
typo graphical errors wer e made shoul d be deleted to clean 
uplHe log, so that it can be easilyunderstood by others. To 
delete a node, the user clicks on the node. The node is 
marked. T he use rj hen specifies a delete instruction from an 
a ction bar menu , or from some other means. This node, and 
all of its chil3Fen are deleted. This is accomplished by 
removing the selected node from the selected node's imme- 
diate parent. It may also be beneficial to re name query. 
graph, or result nodes with names that are more descriptive. 
This can be accomplished in a similar, maimer. By clicking 
on a node, the node is marked. The user can then specify a 
re name insUiiction from a menu item of an action bar or 
some other means. Tfie user is then free to type in a new text 
string followed by the enter key. This text string will become 
the new name for the node. Once all the changes have been 
input, the tree is updated in disk storage with the user 
changes and the process returns to step 318. 

If the user's action is to select a node in a tree, in step 330, 
the node is shown with a selective emphasis. The process 



50 



55 



60 



65 



and graph them in a bar, line, or pie chart, using a legend and 
a value. First, the system looks at all of the columns in the 
spreadsheet and uses the first text field as a legend and the 
first numeric field is used as the value for this text field. If 
these fields are not appropriate, the application provides the 
user with a window to type in new legends or choose a new , 
column to override these defaults. 

Next, the computer system wails for the next user action. 
In step 362, the next user action is received and is evaluated 
in step 364. The user input may be a request to modify the 
graph which will result in a modified query statement. In 
step 366, the user marks an area of the graph window and in 
step 368, the query statement is updated as a result of the 
marked area. The resulting new query is stored as a child of 
the current node in step 306 of FIG. 5A. 

The selection of and marking a portion of the graphical 
representation of the results in the graph window can be 
accomplished in a number of different ways depending in the 
nature of the graphical representation. 

If the graphical presentation of results is presented lin- 
early with respect to one of the search parameters, the query 
statement with respect to that search parameter can be 
altered according to the teachings of copending, commonly 
assigned patent application entitled "Graphical Definition of 
Range in the Selection of Data From a Database Field" to S. 
G. U et al, Ser. No. 07/983.095, filed Nov. 24 1992 and 
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hereby incorporated by reference. For example, positions 
along the axis which represents the search parameter in a bar 

graph are defined by a plurality of tacks. Each tack position 
corresponds to a value for the search parameter By marking 
a field between two tack positions, the user can modify an 
SQL between statement to correspond to the values which 
fall between the corresponding search parameter values. 

For a pie chart or a bar chart, each piece of pie or each bar 
displays information belonging to a certain category or 
range of search parameters. By selecting, i.e, marking, one 
or more pie pieces or bars, the query statement could be 
altered to search for data which satisfy the selected catego- 
ries or ranges. If the results are presented in a line or scatter 
chart in two or three dimensions, a rectangle or cube may be 
drawn around regions of interest. Each of the edges of the 
rectangle or cube would correspond to the upper or lower 
value in a range of values of search parameters graphed 
along a particular axis. The SQL between clause for a 
plurality of query parameters can be modified to correspond 
to the selection range of values as in the above referenced 
application. Since at least one of the graphed parameters 
must be a result rather than a search parameter, the selection 
by means of a box or cube can also mean not to present 
results which occur outside the selected range. 

Modifying the query statement to produce a new query 
statement according to manipulation of the graphed results 
of the query statement is taught in greater detail in com- 
monly assigned, copending application Ser. No. 08/072,618 
and now U.S. Pat No. 5,608,899 entitled "Method and 
Apparatus for searching a Database" filed on the same date 
as the present application which is hereby incorporated by 
reference. 

Alternatively, the user input in steps 362 and 364 may be 
to display the query statement or a mouse click on a query 
window. In step 370, the screen focus is set to the query 
window. Alternatively, the user may wish to display the tree 
in the tree window, in which case, the process returns to step 
318 in FIG. 5A. 

If there are too many nodes to be presented within the 
display space allotted to the history window, the user may 
scroll back to prior nodes via scroll bars attached to the 
edges of the windows. An alternative embodiment of the 
invention, could display the query statement and its result 
with a single symbol to save display space. If the symbol is 
selected, an exploded version of the symbol is presented in 
which both the query statement and result are visible and 
selectable. While the operating system can theoretically 
handle infinitely large presentations through the use of the 
scroll bars, with a large tree and a small history window, the 
search system will be less effective in summarizing the 
query history. However, it will still be better than the prior 
art systems. 

One alternative embodiment would allow the user to 
scroll the query or graph windows to concurrently show the 
associated query statements and results. This provides an 
excellent means to gain a more detailed understanding of the 
summary of the query as presented within the tree. As the 
query statement and its results are linked together as parent 
and child objects, input to the scroll bars could be another 
entry to the process described above in connection v^ath 
FIGS. 5A-5C. 

As the scrolling or other manipulations takes place, the 
current node in the tree could be emphasized each time the 
presentation in the history window is refreshed. 

As mentioned above, the search system is not limited to 
the SQL query. There are several query languages that would 
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work well within the framework of this invention. IBM's 
Query By Example (QBE) is one example of another query 
language which would work well within this context. 
Further, the graphical representation is not limited to a 

5 business graph. In fact, it is easy to store pictorial data in a 
relational database. Many relational database managers store 
pictorial information into a file. Within the relational data- 
base table which contains a reference to the pictorial 
information, a pointer or offset into the file is stored within 
the relation^ database. This method can also be used to store 

^ additional types of multimedia data, such as sound 
information, e.g., the relational database table can contain 
the title and track number on an ordinary music compact 
disk. 

As depicted in FIG. 6, a film archival system which when 
searched will display results in fiill motion video is an ideal 
application. Using the query statement to select a list of 
frames and the graph window 401 to present the results, this 
solution can effectively be used to find clips within a 
database of video. One relational database table could con- 
20 tain records which each have 1) a movie or selection name, 
2) the name of the file that contains the movie, 3) a frame 
identifier that contains the offiset within the file of the frame 
in question, 4) a time stamp for synchronization purposes 
(the frame is displayed at this time stamp). The query 
25 statement 403 in the query window 405^ could read: 
SELECT FRAMES, FROMmovie_table, WHERE 
TIME>1:00:00 and time<l:00:30 and MOVIE-"Terminator 
5", ORDERBYTIME; This query statement 403 would 
display the 30 seconds of video 406 within the graph 
3g window 401, which satisfy the query statement. To make 
scrolling through the frames effective, rewind, fast forward, 
play, and single step buttons 407 could be presented and 
used in the usual way. The history window 409, as before, 
would provide a convenient means of tmderstanding the 
35 previously viewed film clips and the query statements used 
to di^lay them. 

While the invention has been described with respect to 
particular embodiments above, it will be understood by 
those skilled in the art that modifications may be made 
40 without departing from the spirit and scope of the present 
invention. These embodiments are for purposes of example 
and illustration only and are not to be taken to limit the scope 
of the invention narrower than the scope of the appended 
claims. 
45 We claim: 

1. A method of searching a database stored on a computer 
system having a display, comprising the steps of: 

concurrently displaying, in respective first, second and 
third windows of the display: 
50 a first query statement; 

a first set of results from a database search of the first 

query statement; 
a symbolic representation of one or more query state- 
ments entered during a current query session involv- 
55 ing multiple queries including the first query state- 

ment; and 

linking the respective first, second and third windows 
such that alteration of given information in one of the 
windows alters the display of information in at least 
60 one of the other windows, wherein the linking step 
includes the steps of 

marking a section of the first set of results in response 
to user input; 

creating a second query statement according to the first 
65 query statement and the marked section; 

displaying a second set of results from a database 
search of the second query statement; and 
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modifying the symbolic representation to include a 
representation of the second query statement. 

2. The method as recited in claim 1 wherein the symbolic 
representation is a tree structure including one or more 
nodes, the first query statement displayed as a parent node 
in the tree structure and the first set of results displayed as 
a child node of the parent node. 

3. The method as recited in claim 2 wherein the linking 
step comprises the steps of: 

selecting a node in the tree structure in response to user 
input; 

presenting a second query statement represented by the 

selected node; and 
displaying a set of results from searching the second 

query statement represented by the selected node. 

4. The method as recited in claim 3 wherein the linking 
step ftirther comprises the steps of: 

modifying the second query statement in response to user 

input to create a third query statement; 
di^laying the third query statement; 
displaying a third set of results from a database search of 

the third query statement; and 
modifying the tree structure to include a node correspond- 

ing to the third query ^atement and to include a node 

corresponding to the third set of results. 

5. The method as recited in claim 2 wherein the linking 
step comprises the step of: 

deleting at least one node in the tree structure representing 
an unsuccessful query statement. 

6. The method as recited in claim 1 

wherein the symbolic representation includes a first sym- 
bol representative of both the first query statement and 
the first set of results and the linking steps includes the 
steps of: 

selecting the first symbol; and 

displaying an exploded version of the first symbol in 
which both the first query statement and the first set of 
results are separately displayed and selectable. 

7. A computer program product in a computer readable 
memory for controlling a processor to search a database 
stored on a computer system, the product comprising: 

means for concurrently displaying, in respective first, 
second and third windows of a display of the computer 
system: 

a first query statement; 

a first set of results from a database search of the first 
query statement; and 

a symbolic representation of one or more query state- 
ments entered during a current query session involving 
multiple queries including the first query statement; 
and; 

means for linking the respective first, second and third 
windows such that alteration of given information in 
one of the windows alters the display of information in 
at least one of the other windows, wherein the means 
for linking comprises: 

means for marking a section of the first set of results in 
response to user input; 

means for creating a second query statement according to 
the first query statement and the marked section; 

means for displaying a second set of results from a 
database search of the second query statement; and 

means for modifying the symbolic representation to 
include a representation of the second query statement. 
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8. The product as recited in claim 7 wherein the symbolic 
representation is a tree structure including one or more 
nodes, the first query statement displayed as a parent node 
in tree structure and the first set of results displayed as a 

5 child node of the parent node. 

9. The product as recited in claim 8 wherein the linking 
means comprises: 

means for selecting a node in the tree structure in response 
to user input; 

means for presenting a second query statement repre- 
sented by the selected node; and 

means displaying a set of results from searching the 
second query statement represented by the selected. 

10. The product as recited in claim 9 wherein the linking 
means fiirther comprises: 

means for modifying the second query statement in 
response to user input to create a third query statement; 
means for displaying the third query statement; 
20 means displaying a third set of results from a database 
search of the third query statement; and 
means for modifying the tree structure to include a node 
corresponding to the third query statement and to 
include a node corresponding to the third set of results. 
25 11. The product as recited in claim 8 wherein the Unking 
means comprises: 
means for deleting a node in the tree stnictiu-e represent- 
ing an unsuccessful query statement; and 
means for automatically deleting any child nodes of the 
deleted node. 

12. The product as recited in claim 7 wherein the first and 
second windows are concurrently scrolled to respectively 
display query statements and corresponding sets of results 
siimmarized in reports. 
^5 13. A system including processor, memory, display and 
input device for searching a computer stored database, 
comprising: 

means for concurrently displaying, in respective first, 
second and third windows of a display of the computer 
^ system: 

a first query statement; 

first set of results from a database search of the first query 
statement; and 

a symbolic representation of one or more query state- 
ments entered during a current query session involving 
multiple queries including the first query statement; 
and; 

means for linking the respective first, second and third 
windows such that alteration of given information in one of 
the windows alters the display of information in at least one 
of the other windows, wherein the means for linking com- 
prises: 

means for marking a section of the first set of results in 

response to user input; 
means for creating a second query statement according to 

the first query statement and the marked section; 
means for displaying a second set of results from a 
database search of the second query statement; and 
60 means for modifying the symbolic representation to 
include a representation of the second query statement 
and a representation of the second set of results. 
14. The system as recited in claim 13 wherein the sym- 
bolic representation is a tree structure including one or more 
65 nodes, the first query statement displayed as a parent node 
in the tree structure and the first set of results displayed as 
a child node of the parent node. 
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15. The system as recited in claim 14 wherein the linking 
means comprises: 

means for selecting a node in the tree structure in response 

to user input; 

means for presenting a second query statement repre- 
sented by the selected node; and 

means for displaying a set of results from searching the 
second query statement represented by the selected 
node. 

16. The system as recited in claim 15 wherein the linking 
means further comprises: 

means for modifying the second query statement in 
response to user input to create a third query statement; 

means for displaying the third query statement; 15 

means for searching the database according to the third 
query statement and displaying a third set of results 
from a database search of the third query statement; and 

means for modifying the tree structure to include a node 
corresponding to the third query statement and to 
include a node corresponding to the third set of results. 

17. The system as recited in claim 14 wherein the linking 
means comprises: 

means for changing a symbol in the tree structure repre- ^ 
senting a node to be more descriptive of the node. 

18. The system as recited in claim 13 wherein scroll bars 
are provided to display query statements outside a current 
display space in the third window. 

19. A method of editing a database of stored video data 
stored on a computer system having a display, comprising 
the steps of: 

opening on the display a query window, a history window 
and a video window; 

searching for a first segment of video data in response to 35 
the user input of a first query statement, the first query 
statement displayed in the query window; 

displaying a symbolic representation including a first 
symbol representative of the first query statement in the 
history window; 40 

displaying the first segment in the video window; and 

linking the respective query, history and video windows 
such that alteration of given information in one of the 
windows alters the display of information in. at least 
one of the other windows, wherein the linking step 
includes the steps of; 

taking a given action in response to user input in the 

video window; 
creating a second query statement according to the first 

query statement and the given action; 
displaying a second video segment from a database 

search of the second query statement; and 
modifying the symbolic representation to include a 

representation of the second query statement. 

20. A video data editing system including processor, 
memory, display and input device, comprising: 
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means for opening on the display a query window, a 

history window and a video window; 
means for searching for a first segment of video data in 

response to the user input of a first query statement, the 

first query statement displayed in the query window; 
means for displaying a symbolic representation including 

a first symbol representative of the first query statement 

in the history window; 
means for displaying the first segment in the video 

window; and 

means for linking the respective query, history and video 
windows such that alteration of given infonnation in 
one of the windows alters the display of information in 
at least one of the other windows, wherein the means 
for linking step comprises: 

means responsive to user input causing a given action 
in the video window for creating a second query 
statement according to the first query statement and 
the given action; 

means for displaying a second video segment fi-om a 
database search of the second query statement; and 

means for modifying the symbolic representation to 
include a representation of the second query state- 
ment. 

21. A computer program product on a computer readable 
memory executable by a computer system for editing stored 
video data, comprising: 
means for opening on the display a query window, a 

history window and a video window; 
means for searching for a first segment of video data in a 

computer memory in response to the user input of a first 

query statement, the first query statement displayed in 

the query window; 
means for displaying a symbolic representation including 

a first symbol representative of the first query statement 

in the history window; 
means for displaying the first segment in the video 

window on the display; and 
means for linking the respective query, history and video 

windows such that alteration of given infonnation in 

one of the windows alters the display of information in 

at least one of the other windows, wherein the means 

for linking step comprises: 

means responsive to user input causing a given action 
in the video window for creating a second query 
statement according to the first query statement and 
the given action; 

means for displaying a second video segment from a 
database search of the second query statement; and 

means for modifying the symbolic representation to 
include a representation of the second query state- 
ment. 
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PATEtsTTNO : 5.911.138 
DATED : Jun.8.1999 

INVENTOR(S) : Lietal. 

It is certified that error appears in the above-identified patent and that said Letters Patent is 
hereby corrected as shown below: 

In Claim 8. Line 4, after "In" Insert -the- 

In Claim 9. Line 13, after "selected" Insert -node- 

In aaim 13, Line 42, insert -a- before '^rsf 
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